PHOTOGRAPHIC POINTER POSITIONING SYSTEM AND ITS OPERATION PROCESS 
This application claims the priority benefit of Taiwan patent application 
number 092132069 filed on November 14, 2003. 

DESCRIPTION 

BACKGROUND OF THE INVENTION 
[Para 1] 1 . Field of the Invention 

[Para 2] The present invention relates to pointer positioning system for use 
in a shooting game and more particularly, to a photographic pointer 
positioning system, which uses a camera to pick up the image signal of the 
whole display screen, an image processing circuit to process of the image 
signal, at least one reference sign to facilitate the processing of the image 
signal by the image processing circuit, a computing unit to calculate the 
coordinate value of the aiming point of the camera at the display screen 
subject to the data of the image signal obtained from the image processing 
circuit. A correction procedure is provided for correcting the aiming point of 
the photographic pointing device of the photographic pointer positioning 
system. 

[Para 3] 2. Description of the Related Art 

[Para 4] Since the invention of CRT (cathode ray tube) in 1 897, CRT display 
device has been intensively used In TV and computer for video output for the 
advantages of good picture quality of low manufacturing cost. When entered 
the era of 90's, TFT LCD, PDP (Plasma Display Panel) and FPD are developed 
and commercialized to challenge the leading position of CRT display device in 
market. TFT LCD is the most possible product to take the place of conventional 
CRT display device in market in the very near future. TFT LCD Nowadays, most 
personal computer systems are equipped with a TFT LCD instead of CDT (Color 
Display Tube) monitor. 
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[Para 5] Further, since the commercialization of PDP in 1 985, many 
manufacturers were involved in developing big-size PDPs. During Nagano 
Winter Olympics in Japan, many big-size PDPs were announced and appeared 
on the market. 

[Para 6] Following the development of PDP technology, "Reality 9200" using 
the LCD technology enables the Pixel Map Processor system to display all video 
signals in bright circumstance. Japan JVC create "Direct Drive Light Amplifier; 
D-DLA" for DHTV. Texas Instrument also disclosed so-called "DMD projecting 
technology. These products provide clear and bright picture quality. However, 
these products are still not satisfactory in function because of the drawbacks 
of short service life of projecting lamp bulbs (about 250~500 hours) and high 
noise of cooling fan. Further, hologram 3D projection systems have also been 
developed. 

[Para 7] As indicated above, display technology has been continuously 
developed at a fast speed. Same as the advanced TFT LCD and PDP, FED (Field 
Emission Display) follows CRT and CDT to enter the market. 

[Para 8] Further, light gun has been intensively used in shooting game 
machines to substitute for Joystick to aim the object in the display screen, 
enhancing the reality of the game. Regular light guns for shooting game 
include first-generation light guns and second-generation light guns. When a 
first-generation light gun is used in a shooting game machine, the main unit 
of the game machine is controlled to calculate the coordinate value of the 
cursor. When a second-generation light gun is used in a shooting game 
machine, the light gun is controlled to calculate the coordinate value of the 
cursor and then to send the calculated result to the game machine main unit. 
FIG. 1 is a circuit block diagram showing a first-generation light gun used in a 
shooting game machine. The light gun 70 is connected to the game machine 
main unit 20 by a cable. When the user aimed the light gun 70 at the display 
screen 10 and fired a signal, the photo receiver 30 of the light gun 70 will 
receive the impact area signal from the display screen 1 0 and send the 
received impact area signal to the game machine main unit 20, so that the 
game program running by the game machine main unit 20 can calculate the 
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coordinate value of the impact area at the display screen 1 0 subject to the data 
of the impact area signal and the video signal 60 from the game machine main 
unit 20 for further game program processing. 

[Para 9] According to the conventional first-generation and second- 
generation light guns, the impact area signal or synchronous signal produced 
at the display screen is used for further signal processing or X,Y coordinate 
value calculation. Therefore, TFT LCD, PDP, projection system, or any of a 
variety of display means that cannot product such an impact area signal 
cannot be used with the aforesaid first-generation and second-generation 
light guns for playing a shooting game. Further, due to personal shooting 
habit or different location of aiming point, there may be an error between the 
aiming point and the impact area. In this case, a correction is necessary. 



SUMMARY OF THE INVENTION 

[Para 10] The present invention has been accomplished under the 
circumstances in view. It is therefore the main object of the present invention 
to provide a photographic pointing device for photographic pointer positioning 
system, which fits any of a variety of display devices. It is another object of the 
present invention to provide a photographic pointer positioning system, which 
uses a correction procedure to correct any errors produced due to personal 
shooting habit or different location of sights at the light gun. To achieve these 
and other objects of the present invention, the photographic pointer 
positioning system comprises a photographic pointing device connectable to a 
game machine main unit (system main unit) and a display screen through a 
communication interface thereof. The photographic pointing device uses a 
camera controlled by a control circuit to pick up the image of the whole display 
area of the display screen, an image processing circuit to process of the image 
signal, at least one reference sign to facilitate the processing of the image 
signal by the image processing circuit, a computing unit to calculate the 
coordinate value of the aiming point of the camera at the display screen 
subject to the data of the image signal obtained from the image processing 
circuit, and buttons for operation by user. 
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BRIEF DESCRIPTION OF THE DEAWINGS 

[Para 1 1 ] FIG. 1 is a circuit block diagram showing a wired light gun used in a 
shooting game according to the prior art. 

[Para 1 2] FIG. 2 is a circuit block diagram of a photographic pointer 
positioning system according to the first embodiment of the present invention. 

[Para 1 3] FIG. 3 is an operation flow chart of the photographic pointer 
positioning system according to the first embodiment of the present invention. 

[Para 1 4] FIG. 4 is a circuit block diagram of a photographic pointer 
positioning system according to the second embodiment of the present 
invention. 

[Para 1 5] FIG. 5 is an operation flow chart of the photographic pointer 
positioning system according to the second embodiment of the present 
invention. 

[Para 16] FIG. 6 is a schematic drawing showing one reference sign installed 
in the border area of the display screen around the display area according to 
the present invention. 

[Para 1 7] FIG. 7 is a schematic drawing showing a light gun-like photographic 
pointing device aimed at the center point of the display area of a display 
screen according to the present invention. 

[Para 1 8] FIG. 8 is a correction flow chart of the photographic pointer 
positioning system according to the first embodiment of the present invention. 

[Para 1 9] FIG. 8A is a schematic drawing showing the photographic pointing 
device of the photographic pointer positioning system of the first embodiment 
of the present invention aimed at the center point of the display area of the 
display screen according to the first embodiment of the present invention. 

[Para 20] FIG. 8B is a schematic drawing explaining the relationship between 
the coordinate value B of the center point of the display area of the display 
screen in the photographed area and the coordinate value C of the aiming 
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point of the camera at the display area of the display screen according to the 
first embodiment of the present invention. 

[Para 21 ] FIG. 9 is a correction flow chart of the photographic pointer 
positioning system according to the second embodiment of the present 
invention. 

[Para 22] FIG. 9A is a schematic drawing showing the photographic pointing 
device of the photographic pointer positioning system of the first embodiment 
of the present invention aimed at the center point of the display area of the 
display screen according to the second embodiment of the present invention. 

[Para 23] FIG. 9B is a schematic drawing explaining the relationship between 
the coordinate value B of the center point of the display area of the display 
screen in the photographed area and the coordinate value C of the aiming 
point of the camera at the display area of the display screen according to the 
second embodiment of the present invention. 

[Para 24] FIG. 1 0 is a schematic drawing showing another installation example 
of the reference sign within the display area according to the present 
invention. 

DETAILED DESCRIPTION OF EMBODIMENT 

[Para 25] Referring to FIG. 2, a photographic pointer positioning system in 
accordance with the present invention comprises a photographic pointing 
device 200. According to the first embodiment of the present invention, the 
photographic pointing device 200 comprises a control circuit 210, a 
communication interface 220, a camera 230, a computing unit 240, an image 
processing circuit 250, and a set of buttons 260. By means of the 
communication interface 220, the photographic pointing device 200 is 
connectable to a game machine main unit (system main unit) 20, which has a 
display screen 1 0 connected thereto. The buttons 260 are electrically 
connected to the control circuit 21 0 for operation by the user to input 
commands to drive the game machine main unit (system main unit) 20 to run a 
predetermined game program. The control circuit 210 is electrically connected 
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to the camera 230, the computing unit 240 and the image processing circuit 
250 to control their operation. The camera 230 is controlled by the control 
circuit 2 1 0 to take the picture of a whole display area 1 1 of the display screen 
1 0 and to transmit the obtained image signal to the control circuit 210, which 
in turn transmits the image signal to the image processing circuit 250 to 
receive scan and recognition processes. After scan and recognition processes, 
the image processing circuit 250 sends the processed image signal to the 
control circuit 210, enabling the control signal 21 0 to input the processed 
image signal into the computing unit 240, which computes the data of the 
processed image signal to find out the actual coordinate value of the aimed 
point of the camera 230 at the display screen 1 0 and then outputs the 
coordinate value to the control circuit 21 0 so that the control circuit 210 will 
transmit the coordinate value to the game machine main unit (system main 
unit) 20 for further game program processing. 

[Para 26] Referring to FIGS. 2, 3 and 6, when the user uses the game machine 
main unit (system main unit) 20, the photographic pointing device 200 and the 
display screen 1 0 to play a shooting game, the photographic pointer 
positioning system is operated subject to the following procedure, which 
comprises the steps of: 

[Para 27] (100) Start; 

[Para 28] (1 1 0) Mounting at least one reference sign 1 2 in the border area of 
the display screen 1 0 around the display area 1 1 ; 

[Para 29] (1 20) Controlling the camera 230 to pick up the image of the whole 
display area 1 1 of the display screen 1 0 and to send the image signal thus 
obtained back to the control circuit 2 1 0; 

[Para 30] (1 30) Controlling the image processing circuit 250 to run scan and 
recognition processes by means of using the reference sign 1 2 for compare 
and to send the processed data back to the control circuit 210; 

[Para 31 ] (1 40) Comparing the processed data obtained from the image 
processing circuit 250 to the pixels of the camera 230 to obtain the coordinate 
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values of the four corners of the display area 1 1 of the display screen 1 0 in the 
photographed picture; 

[Para 32] (1 50) Sending the coordinate values of the four corners of the 
display area 1 1 of the display screen 10 in the photographed picture and the 
coordinate value of the center point of the camera 230 to the computing unit 
240, and driving the computing unit 240 to put these coordinate values into a 
distance formula so as to obtain every side length of the display area 1 1 of the 
display screen 1 0 in the photographed picture; 

[Para 33] (1 60) Controlling the computing unit 240 to calculate the 
proportional value of every side length of the display area 1 1 of the display 
screen 1 0 in the photographed picture relative to the respective actual side 
length of display screen 10, and then to multiply the respective side length of 
the display area 1 1 of the display screen 1 0 in the photographed picture by the 
proportional value to obtain the respective actual side length data of the 
display area 1 1 of the display screen 1 0; 

[Para 34] (1 70) Using the respective actual side length data of the display area 
1 1 of the display screen 1 0 obtained from the computing unit 240 to write an 
affected quadratic simultaneous equation with two unknown, and then sending 
the related data to the computing unit 240 for enabling the computing unit 
240 to find the answer of this affected quadratic simultaneous equation with 
two unknown and to send the X, Y values of the calculation result back to the 
control circuit 210; 

[Para 35] (1 80) Using the X, Y values obtained from the computing unit 240 to 
determine the X, Y values to be the coordinate value of the aiming point of the 
camera 230, and then sending this coordinate value of the aiming point of the 
camera 230 to the game machine main unit (system main unit) 20 via the 
communication interface 220, for enabling the game machine main unit 
(system main unit) 20 to run further related program control based on the 
aiming point of the camera 230; 

[Para 36] (190) End. 
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[Para 37] FIG. 4 shows an alternate form of the photographic pointer 
positioning system. According to this alternate form, the photographic pointer 
positioning system comprises a photographic pointing device 400, a game 
machine main unit (system main unit) 450, and a display screen 10. The 
photographic pointing device 400 comprises a control circuit 410, a 
communication interface 420, a camera 430, and a set of buttons 440. The 
display screen 1 0 is electrically connected to the game machine main unit 
(system main unit) 450. The communication interface 420 is connectable to 
the game machine main unit (system main unit) 450. The camera 430 is 
controlled by the control circuit 410 to take the picture of the whole display 
area 1 1 of the display screen 1 0 and to transmit the obtained image signal to 
the control circuit 41 0, which in turn transmit the obtained image signal to the 
game machine main unit (system main unit) 450 for enabling the game 
machine main unit (system main unit) 450 to find out the actual coordinates 
value of the aiming point of the camera 430 for further game program 
processing. The buttons 460 are signal emitting buttons of the camera 430 for 
operation by the user to input commands to play the game. 

[Para 38] Referring to FIGS. 5 and 6 and FIG. 4 again, when the user uses the 
game machine main unit (system main unit) 450, the photographic pointing 
device 400 and the display screen 1 0 to play a shooting game, the 
photographic pointer positioning system is operated subject to the following 
procedure, which comprises the steps of: 

[Para 39] (300) Start; 

[Para 40] (310) Mounting at least one reference sign 1 2 in the border area of 
the display screen 1 0 around the display area 1 1 ; 

[Para 41 ] (320) Controlling the camera 430 to pick up the image of the whole 
display area 1 1 of the display screen 1 0 and to send the image signal thus 
obtained back to the control circuit 41 0; 

[Para 42] (330) Driving the control circuit 410 to send the image signal 
obtained from the camera 430 to the game machine main unit (system main 
unit) 450 via the communication interface 420; 
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[Para 43] (340) Controlling the game machine main unit (system main unit) 
450 to run scan and recognition processes by means of using the reference 
sign 1 2 for compare; 

[Para 44] (350) Driving the game machine main unit (system main unit) 450 to 
compare the processed data to the pixels of the camera 430 so as to obtain 
the coordinate values of the four corners of the display area 1 1 of the display 
screen 1 0 in the photographed picture; 

[Para 45] (360) Driving the game machine main unit (system main unit) 450 to 
put the coordinate values of the four corners of the display area 1 1 of the 
display screen 10 in the photographed picture and the coordinate value of the 
center point of the camera 430 into a distance formula so as to obtain every 
side length of the display area 1 1 of the display screen 1 0 in the photographed 
picture; 

[Para 46] (370) Controlling the game machine main unit (system main unit) 
450 to calculate the proportional value of every side length of the area 1 1 of 
the display screen 10 in the photographed picture relative to the respective 
actual side length of display screen 1 0, and then to multiply every side length 
of the area 1 1 of the display screen 10 in the photographed picture by the 
respective proportional value so as to obtain the actual side length data of 
every side of the display screen 1 0; 

[Para 47] (380) Driving the game machine main unit (system main unit) 450 to 
write an affected quadratic simultaneous equation with two unknown based on 
the actual side length data of every side of the display screen 1 0 and to find 
the answer of this affected quadratic simultaneous equation with two unknown 
so as to obtain the X, Y values of the aiming point of the camera 430; 

[Para 48] (390) Driving the game machine main unit (system main unit) 450 to 
output the X, Y values of the aiming point of the camera 430 to the display 
screen 1 0 for further game program processing; 

[Para 49] (400) End. 

[Para 50] The photographic pointer positioning system of the present 
invention may be used in a computer system, big game machine, TV game 



Page 9 of 35 



machine, or computer terminal system. When used in a computer system, the 
photographic pointer positioning system will substitute for the functions of a 
mouse, a tablet, and a light gun. 

[Para 51] FIG. 7 is a schematic drawing showing a light gun-like photographic 
pointing device 500 aimed at a center point 530 of the display area 1 1 of a 
display screen 1 0 according to the present invention. The light gun-like 
photographic pointing device 500 has a camera 520 provided at the periphery 
of the gun barrel thereof at one side below the elevation of the front and rear 
sights 5 1 0. A trigger 540 of the light gun-like photographic pointing device 
500 serves as a firing button. Because the camera 520 and the sights 510 are 
arranged at different elevations, there may be an error between the aiming 
point and the actual coordinate value. Therefore, a correction procedure is 
necessary. The correction procedure of the photographic pointer positioning 
system according to the first embodiment of the present invention, as shown 
in FIGS. 2 and 8, includes the steps of: 

[Para 52] (800) Start; 

[Para 53] (81 0) Aiming the sights 270 of the light gun-like photographic 
pointing device 200 at the coordinate value A of the center point 280 of the 
display area 1 1 and then pressing the button 260 (see FIG. 8A); 

[Para 54] (820) Driving the camera 230 to take the picture of the whole 
display area 1 1 of the display screen 1 0 so as to obtain a photographed area 
1 1 1 (see FIG. 8B), and then driving the camera 230 to send the image signal of 
the photographed area 1 1 1 to the control circuit 210; 

[Para 55] (830) Driving the control circuit 210 to send the image signal of the 
photographed area 1 1 1 to the image processing circuit 250 for running scan 
and recognition processes and then driving the image processing circuit 250 
to send the processed data back to the control circuit 210; 

[Para 56] (840) Comparing the processed data obtained from the image 
processing circuit 250 to the pixels of the camera 230 to obtain the coordinate 
values of the four corners of the display area 1 1 of the display screen 10 in the 
photographed area 111; 
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[Para 57] (850) Calculating the coordinate value B of the center point 280 of 
the display area 1 1 in the photographed area 111; 

[Para 58] (860) Putting the coordinate value B of the center point 280 of the 
display area 1 1 In the photographed area 1 1 1 Into the coordinate value C of 
the aiming point 290 of the camera 230 (see FIG. 8B); 

[Para 59] (870) Therefore, the aiming point of the sights 270 of the light 
gun-like photographic pointing device 200, the center point 280 of the display 
area 1 1 and the aiming point 290 of the camera 230 are overlapped; 

[Para 60] (880) End. 

[Para 61] The correction procedure of the photographic pointer positioning 
system according to the second embodiment of the present invention, as 
shown In FIGS. 4 and 9, Includes the steps of: 

[Para 62] (900) Start; 

[Para 63] (91 0) Aiming sights 460 of the light gun-like photographic pointing 
device 400 at a coordinate value A of a center point 470 of the display area 1 1 
and then pressing the button 440 (see FIG. 9A); 

[Para 64] (920) Driving the camera 430 to take the picture of the whole 
display area 1 1 of the display screen 1 0 so as to obtain a photographed area 
1 1 1 (see FIG. 9B), and then driving the camera 430 to send the Image signal of 
the photographed area 1 1 1 to the control circuit 41 0; 

[Para 65] (930) Driving the control circuit 41 0 to send the Image signal of the 
photographed area 1 1 1 to the game machine main unit (system main unit) 450 
through the communication Interface 420; 

[Para 66] (940) Driving the game machine main unit (system main unit) 450 to 
run scan and recognition processes subject to the Image signal of the 
photographed area 1 1 1 received from the control circuit 210; 

[Para 67] (950) Driving the game machine main unit (system main unit) 450 to 
compare the processed Image signal data to the pixels of the camera 430 so 
as obtain the coordinate values of the four corners of the display area 1 1 of 
the display screen 1 0 in the photographed area 111; 
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[Para 68] (960) Driving tPie game machine main unit (system main unit) 450 to 
calculate the coordinate value B of the center point 470 of the display area 1 1 
in the photographed area 111; 

[Para 69] (970) Putting the coordinate value B of the center point 470 of the 
display area 1 1 in the photographed area 1 1 1 into the coordinate value C of 
the aiming point 480 of the camera 430 (see FIG. 9B); 

[Para 70] (980) Therefore, the aiming point of the sights 460 of the light gun- 
like photographic pointing device 400, the center point 470 of the display area 
1 1 and the aiming point 480 of the camera 430 are overlapped; 

[Para 71] (990) End. 

[Para 72] In the aforesaid embodiments, the communication interface 220 or 
420 of the photographic pointing device 200 or 400 can be a USB interface, 
1 394 interface, PS2 interface, or any suitable interface connectable to the 
game machine main unit (system main unit) 20 or 450 through a signal line for 
signal transmission between the control circuit 21 0 or 41 0 and the game 
machine main unit (system main unit) 20 or 450. 

[Para 73] According to the present invention, the communication interface 
220 or 420 is a wireless transmitting receiving interface having installed 
therein a wireless transmitter and a wireless receiver. The game machine main 
unit (system main unit) 20 or 450 has a corresponding wireless transmitter 
receiver module for wireless communication with the communication interface 
220 or 420. 

[Para 74] Further, the aforesaid reference sign 1 2 can be an illuminator 
formed of a light emitting diode, bulb, or any suitable light emitting materials. 
In the aforesaid first and second embodiments of the present invention, the 
reference sign 12 is installed in the border area of the display screen 10 
around the display area 1 1 . Alternatively, the reference sign 1 2 can be 
installed within the display area 1 1 of the display screen 1 0 (see FIG. 1 0). 

[Para 75] Although a particular embodiment of the invention has been 
described in detail for purposes of illustration, various modifications and 
enhancements may be made without departing from the spirit and scope of 
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the invention. Accordingly, tlie invention is not to be limited except as by the 
appended claims. 
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